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Executive Summary 



A job analysis was conducted to define the content domain important for newly licensed (certified) 
music teachers to perform their jobs in a competent manner. The results of the job analysis will be used to 
develop test specifications for the subject assessment in music of the Praxis Series: Professional 
Assessments for Beginning Teachers™. 

An initial draft domain of knowledge statements was constructed by Educational Testing Service 
(ETS) test development staff with subject-matter expertise in music and ETS research staff with expertise 
in job analysis methodology. In the process of developing the draft domain, ETS subject-matter experts 
reviewed previous National Teacher Examination (NTE) music test specifications, state licensure and 
certification requirements, and relevant professional literature. The resultant draft domain consisted of six 
major content areas and 84 knowledge statements. The six major content areas were: (1) Music History 
and Literature, (2) Composition/Theory, (3) Acoustical Theory, (4) Performance Media, (5) Performance, 
and (6) Content-Specific Pedagogy. 

This draft domain was then reviewed by an External Review Panel of 10 subject-matter experts: five 
classroom teachers, four college faculty, and one state administrator. The panel reviewed the draft domain 
for the appropriateness of its overall structure and the appropriateness of the specific statements and their 
completeness and clarity. Revisions suggested by the panel, including additions and deletions of content 
areas and knowledge statements, were obtained via telephone interviews conducted by ETS research staff. 
Wording changes were made to the draft domain and some additional statements were included. The 
revised domain consisted of 93 statements. 

This revised draft domain was then reviewed by an advisory committee of three classroom music 
teachers and six college faculty. This committee was charged with modifying the revised draft domain so 
that it accurately reflected what the members of the committee believed were the knowledge areas 
important for newly licensed (certified) music teachers. This modification process occurred during a three- 
day meeting held in Princeton, New Jersey. The committee made numerous changes to the job analysis 
inventory, including changes to the knowledge statements themselves and changes to the category headings 
and directions. The final form of the job analysis inventory comprises 126 knowledge statements grouped 
into five categories: (1) Music History and Literature, (2) Theory/Composition, (3) Performance Media, 

(4) Performance, and (5) Music Pedagogy. 

This revised domain was then subjected to verification/refutation through a national survey of 843 
teachers (approximately 17 per state and the District of Columbia), 408 college faculty (approximately 8 
per state and D.C.), and 102 school administrators (approximately 2 per state and D.C.) for a total of 1,353 
education professionals. In order to reach appropriate individuals, the mailing list was acquired from the 
membership rosters of several professional associations in music education. Names from the rosters were 
drawn at random in such a way as to satisfy the state participation requirements stated above. 

The survey participants were asked to rate the statements in terms of their importance for newly 
licensed (certified) music teachers to perform their jobs in a competent manner. The 5-point rating scale 
ranged form 0 (of no importance) to 4 (very important). The purpose of the survey administration was to 
identify a core of knowledge statements that relatively large numbers of education professionals verified to 
be important to newly licensed (certified) music teachers. The latter objective is accomplished by 
analyzing the mean importance ratings provided by two groups of education professionals (i.e., teachers 
and college faculty) and by appropriate subgroups of respondents (i.e., sex, race/ethnicity, geographic 



region, teaching experience). Statements that are judged to be important by both respondent groups and 
all subgroups define the core. The core becomes the primary database for the development of test 
specifications. The derivation of test specifications from those knowledge areas verified to be important by 
the surveyed education professionals provides a substantial evidential basis for the content validity and 
relevance of The Praxis II Subject Assessment in Music. 

Two types of data analysis were conducted to support the development of content valid test 
specifications: (1) means were computed of the importance ratings for each knowledge statement for 
teachers and college faculty and for appropriate subgroups of respondents and (2) correlations of the 
profiles of these mean importance ratings were computed across the two groups of education professionals 
and subgroups of respondents. 

A cut point of a mean importance rating of 2.50 (the midpoint between moderately important-scale 
value 2-and important-scale value 3) was established to identify the core of important statements. 
Statements that were judged by the education professionals and all subgroups of respondents to be 2.50 or 
higher comprised the core, and, therefore, were considered eligible for inclusion in the development of test 
specifications. However, because the survey participants were not involved in the development of the 
knowledge domain, they may lack certain insights that the Advisory Committee members have due to their 
high level of involvement in the definition of the domain. As a consequence, if the committee believes that 
a knowledge statement rated below 2.50 should be included in the specifications and the committee can 
provide compelling written rationales, those knowledge statements may be reinstated for inclusion in the 
test specifications. 

The results of the mean analysis conducted by teachers and college faculty indicated that 22 of the 
126 statements (17.5%) did not meet the criterion for inclusion. Teachers tended to give slightly lower 
ratings than college faculty. For example, 19 statements failed the inclusion criterion for teachers, while 
1 6 statements did likewise for college faculty. 

Means were also computed for demographic subgroups based on sex, race/ethnicity, geographic 
region, and teaching experience. In this analysis, 28 statements (22.2%) were rated below 2.50. All of the 
statements identified in the prior analysis of employment category were also identified in the subgroup 
analysis. 

The computation of correlation coefficients to assess relative agreement of perceived importance 
revealed a high level of agreement. The coefficients for comparisons among the subgroups all exceeded 
.90. These findings indicate that there is substantial agreement in the relative importance given to the 
statements across a wide array of education professionals. 

The 98 knowledge statements that were verified to be important by the respondents should be used 
as the foundation for the development of test specifications. Test specifications that are linked to the 
results of a job analysis provide support for the content validity of the derived assessment measures and 
may be considered as part of an initial step in ensuring fairness to subgroups of music teacher candidates. 
It is reasonable to assume that, due to testing constraints (e.g., time limits, ability to measure reliably some 
content), not all of the verified content may be included in the assessment measures. One source of 
information that may be used to guide decisions of what verified content to include in the assessment 
measure is the mean importance rating. Although a rank ordering of the content by mean importance 
rating is not implied, it is recommended that initial consideration be given to content that is well above the 
cut point and represents the appropriate breadth of content coverage. 
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Evidence was also provided in this study of the comprehensiveness of the content domain within the 
five major content areas. This information has implications for the adequacy of the content domain. If the 
domain was adequately defined then the categories should be judged to have been well covered by their 
accompanying statements. The results supported the adequacy of the defined content domain. 

Finally, data were collected regarding the emphasis that should be given in the test to each of the five 
categories. This information will be used by the Advisory Committee in their decisions about the 
appropriate weighting of the test. 
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Introduction 



Purpose of the Study 

The subject assessments for The Praxis Series: Professional Assessments for Beginning Teachers™ 
are designed to assess a prospective teacher’s content knowledge of a specific subject area and subject- 
specific pedagogical knowledge. The focus of such tests is based on the premise that beginning teachers 
should demonstrate knowledge of the subjects they intend to teach (Grossman, Wilson, & Shulman, 1989), 
and demonstrate knowledge of teaching principles, strategies, and resources specific to those subjects 
(Grossman, 1989; McDiarmid, Ball, & Anderson, 1989; Reynolds, 1990). The Praxis Series can be used 
by state agencies as one of several criteria for initial teacher licensure or certification. Included as part of 
the subject assessments, is a licensure examination for music teachers. To identify the appropriate content 
domain of this examination and to support the content validity and content relevance of this examination, a 
job analysis was conducted of the knowledge important for newly licensed (beginning) music teachers. 

This report will describe the job analysis study. In particular, it will provide the rationale for conducting 
the job analysis, present the methods used to define job-related knowledge, describe the types of statistical 
analysis conducted, report the results of these analyses, and specify the implications for developing test 
specifications. 

Standards for Educational and, Psychological Testing 

The Standards for Educational and Psychological Testing (1985) is a comprehensive technical 
guide that provides criteria for the evaluation of tests, testing practices, and the effects of test use. It was 
developed jointly by the American Psychological Association (APA), the American Educational Research 
Association (AERA), and the National Council on Measurement in Education (NCME). The guidelines 
presented in the Standards have, by professional consensus, come to define the necessary components of 
quality testing. As a consequence, a testing program that adheres to the Standards is more likely to be 
judged valid and defensible than one that does not. 

There are two categories of criteria within the Standards, primary and secondary. Those classified 
as primary "should be met by all tests . . . unless a sound professional reason is available to show why it is 
not necessary, or technically feasible, to do so in a particular case. Test developers and users ... are 
expected to be able to explain why any primary standards have not been met" (AERA/APA/NCME, 1985, 
p.2). One of the primary standards is that the content domain of a licensure or certification test should be 
defined in terms of the importance of the content for competent performance in an occupation. "Job 
analyses provide the primary basis for defining the content domain." (p.64). 

The use of job analysis to define the content domain is a critical component in establishing the 
content validity of licensure and certification examinations. Content validity is the principle validation 
strategy used for these examinations. It refers to the extent to which the content covered by an 
examination overlaps with the important components (tasks, knowledge, skills, or abilities) of a job (Arvey 
& Faley, 1988). Demonstration of content validity is accomplished through the judgements of subject- 
matter experts. It is enhanced by the inclusion of large numbers of subject-matter experts who represent 
the diversity of the relevant areas of expertise (Ghiselli, Campbell, & Zedeck, 1981). The lack of a well- 
designed job analysis is frequently cited by the courts as a major cause of test invalidity. 
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Job Analysis 



Job analysis refers to procedures designed to obtain descriptive information about the tasks 
performed on the job and/or the knowledge, skills, and abilities thought necessary to adequately perform 
those tasks (Gael, 1983). The specific type of job information collected by a job analysis is determined by 
the purpose for which the information will be used. For purposes of developing licensure and certification 
examinations, a job analysis should identify the important knowledge or abilities necessary to protect the 
public (AERA/APA/NCME, 1 985). In addition, a well-designed job analysis should include the 
participation of various subject-matter experts (Mehrens, 1987); and the data collected should be 
representative of the diversity within the job. Diversity refers to regional or job context factors and to 
subject-matter-expert factors such as gender, race, ethnicity, and experience (Kuehn, Stallings, & Holland, 
1990). The job analysis conducted for music teachers was designed to be consistent with the Standards 
and current professional practice. 

Objectives of the Job Analysis Study 

The objectives of this study were: to construct a comprehensive domain of knowledge that is 
important for newly licensed (certified) music teachers, and to obtain, using survey methodology, the 
independent judgements of a national sample of music education professionals (teachers, college faculty, 
and state administrators) to verify or refute the importance of the domain of knowledge. The 
verification/refutation component serves a critical role to ensure that the domain, in whole or in part, is 
judged to be relevant to the job of a newly licensed (certified) music teacher by a diversity of education 
professionals. The components of the domain that are verified will be used in the development of test 
specifications for the Praxis II Subject Assessment in Music. 



Methods 

The job analysis study described in this report involved a multimethod approach that included 
subject-matter experts and a national survey. In overview, groups of subject-matter experts first defined a 
knowledge domain important for newly licensed music teachers. This knowledge domain was then sent 
out to education professionals through a large-scale, national survey. The purpose of the survey 
administration was to obtain verification and/or refutation from large numbers of education professionals 
that the previous groups of subject-matter experts had defined a content domain of knowledge areas that 
are important for newly licensed music teachers. Through this process we can identify a core of important 
knowledge that is related to the job of the newly licensed music teacher. Thus, the survey functions as a 
"check and balance" on the judgments of the subject-matter experts and reduces the likelihood that 
unimportant knowledge areas will be included in the development of the test specifications. The use of a 
job analysis survey is also an efficient and cost-effective method of obtaining input from large numbers of 
subject-matter experts and enables ratings to be analyzed separately by relevant subgroups. 

The survey participants were music teachers, administrators, and college faculty whose names were 
obtained from membership rosters of several professional associations. The participants were asked to rate 
the job analysis statements in terms of their importance for newly licensed/certified music teachers to 
perform their jobs in a competent manner. The specific steps in the job analysis process are described 
below. 



Definition of the Knowledge Domain 



Develop an initial draft knowledge domain. The first step in the process of conducting the job 
analysis was to construct a preliminary knowledge domain. The domain was constructed by Educational 
Testing Service (ETS) test development staff with subject-matter expertise in music and ETS research staff 
who have expertise in job analysis methodology. In the process of developing the draft, the ETS subject- 
matter experts reviewed state teaching licensure requirements, previous National Teacher Examination 
(NTE) music test specifications, current test items, and relevant professional literature. 

The resultant draft domain consisted of six major content areas: (l) Music History and Literature, 

(2) Composition/Theory, (3) Acoustical Theory, (4) Performance Media, (5) Performance, and 
(6) Content-Specific Pedagogy. Within each category were several knowledge statements that attempted to 
map the important aspects of the category. In this draft, there were 84 statements classified within the six 
categories. 



Evaluation of draft domain by External Review Panel . Consistent with a content validity framework, 
the job analysis study was designed to obtain input from many subject-matter experts at several critical 
points in the domain definition process. To this end, an External Review Panel of 10 music education 
professionals was formed to review the draft domain. This group consisted of five classroom teachers, four 
college faculty and one state administrator. Individuals were considered for membership through a process 
of peer recommendation. All of the review panelists have experience either teaching music or supervising 
teachers of music and they are prominent and active in professional associations and/or teacher licensure. 

In addition to their subject-matter expertise, the panel was formed so as to have representation by sex, 
ethnicity, and geographic location. Members of the panel are listed in Appendix A. 

The panelists were instructed to review the draft and to make modifications they felt were necessary 
to adequately cover the important aspects of teaching music. They were further instructed that these 
modifications could include the addition of important knowledge statements, deletion of unimportant 
statements, elaboration of statements with relevant examples, and revision of statements into language that 
is clear and appropriate for individuals in music education. The panelists were interviewed via telephone 
by ETS research staff to obtain their suggested modifications. 

Information from the interviews was compiled, discussed with ETS test development staff and 
subsequently, used to revise the draft. Wording changes were made to the draft and some additional 
statements were included. The revised draft consisted of 93 statements. 

Advisory Committee meeting . The next step in the job analysis process was a meeting held January 
12-14, 1990 in Princeton, New Jersey with an advisory committee of nine subject-matter specialists. The 
committee was charged with developing a final version of the job analysis inventory and with developing 
the specifications for the new test. Like the external review panelists, members of the advisory committee 
have a documented knowledge of the subject matter. The committee comprises three classroom teachers 
and six college faculty, and has representation by sex, ethnicity, and geographic location. Members of the 
committee are also listed in Appendix A. 

The meeting was led jointly by ETS test development and research staff. Prior to the meeting, 
committee members were mailed a copy of the draft domain to review. They were informed of the purpose 
of the meeting and asked to come prepared to discuss their review. Because they will use the results 
obtained from the survey administration of the content domain, it is critical that committee members have a 



clear understanding of each statement. The group interaction during the meeting fostered discussions that 
generated suggestions not made during the individual interviews with the External Review Panel. The 
committee members attempted to be inclusive (i.e., cover all important aspects of teaching the subject 
matter) rather than exclusive in defining the content domain. 

The committee made numerous changes to the job analysis inventory, including changes to the 
knowledge statements themselves and changes to the category headings and directions in the interest of 
rendering the inventory more appropriate and comprehensive and its statements unambiguous. The final 
form of the job analysis inventory comprises 126 knowledge statements grouped into five categories; 

(1) Music History and Literature, (2) Theory/Composition, (3) Performance Media, (4) Performance, and 
(5) Music Pedagogy. 

During the meeting the Advisory Committee also reviewed and approved the proposed rating scale 
for the inventory. The rating scale required respondents to make judgments regarding importance to the 
newly licensed teacher. The importance scale, which is shown below, is in compliance with professional 
standards (cf. AERA, APA, NCME, 1985). 

How important is it that a newly licensed (certified) Music teacher be able to perform this task in a 

competent manner? 



(0) Of no importance 

(1) Of little importance 

(2) Moderately important 

(3) Important 

(4) Very Important 

The committee also reviewed and approved items concerning demographic and background 
information (e.g., sex, teaching experience, geographic location). Such items were included so that we can 
describe the composition of the survey respondents and conduct analyses of the survey responses by 
various subgroups of respondents (e.g., males and females). 

Pilot test of the job analysis survey . After the meeting, a revised job analysis inventory was mailed 
to the committee members for final approval. Once approval was obtained, the inventory was pilot tested 
on a group of 10 classroom teachers and college faculty. The pilot participants were asked to review the 
survey for clarity of wording and instruction, ease of use, and comprehensiveness of content coverage. 

The pilot test indicated that no one had difficulty completing the inventory and that no additional changes 
were necessary. 

Large-Scale Survey 

Survey instrument . The finalized survey consisted of three parts. Part I included 126 knowledge 
statements categorized under the following five knowledge dimensions: Music History and Literature, 
Theory/Composition, Performance Media, Performance, and Music Pedagogy. Survey respondents were 
asked to rate the statements using the previously mentioned importance scale. 

For each major knowledge dimension there was also a content coverage question in Part I. This 
question asked the survey participants to indicate how well the dimension was covered by its knowledge 
statements. Respondents made their judgements using a 5-point rating scale (l=Poorly, 2=Somewhat, 
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3=Adequately, 4=Well, 5=Very well). The participants also had an opportunity to identify and write in 
knowledge statements that they believed should be added to the domain. 

Part II of the survey asked the participants to indicate the weight or emphasis that each of the major 
knowledge dimensions should receive on the assessment. This was accomplished by distributing 100 
points across the five major dimensions. These point distributions were converted into percentages, 
representing the percent of items that the survey respondents believed should be devoted to each area. 

Part m asked the survey participants for demographic and background information. As previously 
noted, these items are used to describe the respondents and to perform subgroup analyses. A copy of the 
final inventory is provided in Appendix B. 

Survey participants . The sample for this study consisted of 843 teachers (approximately 17 per state 
and the District of Columbia), 408 college faculty (approximately 8 per state and the District of Columbia), 
and 102 school administrators (approximately 2 per state and the District of Columbia) For a total of 1,353 
education professionals (approximately 26 per state and D.C.). In order to reach appropriate individuals, 
the mailing list was acquired from the membership rosters of several professional associations in music 
education. Names from the rosters were drawn at random in such a way as to satisfy the state participation 
requirements noted above. 

Survey administration . The surveys were administered to the sample in May, 1990. Each survey 
was accompanied by a letter of invitation to participate and a postage-paid envelope for its return. A 
reminder postcard was mailed approximately one week after the survey mailing. The cover letter and the 
follow-up postcard are provided in Appendix C. 

The purpose of the survey administration was to identify a core of knowledge statements that 
relatively large numbers of education professionals judged to be relevant (verified to be important) to 
newly licensed (certified) music teachers. The latter objective is accomplished by analyzing the mean 
importance ratings provided by the two groups of education professionals and by the appropriate 
subgroups of respondents. Knowledge statements that are judged to be important by both respondent 
groups and all subgroups define the core. The core becomes the primary database for the development of 
test specifications. The derivation of test specifications from those knowledge statements verified to be 
important by the surveyed music education professionals provides a substantial evidential basis for the 
content validity and relevance of the subject assessment in music. 

Data Analysis 



Two types of data analysis were conducted to support the development of content valid test 
specifications: (1) Means were computed of the importance ratings for each knowledge statement by the 
two groups of music education professionals and by the appropriate subgroups of respondents, and (2) 
correlations of the profiles of these mean importance ratings were computed across the two groups of 
professionals and the appropriate subgroups of respondents. 

Means . The mean analysis is used to determine the level (absolute value) of importance attributed to 
each knowledge statement. Means were computed for teachers and college faculty and for subgroups of 
respondents (subgroups by gender, race/ethnicity, geographic region, and teaching experience). An 
analysis of importance ratings by geographic region is consistent with the recent legal emphasis on 
addressing regional job variability when job analyses are conducted for content domain specification 
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purposes (Kuehn et al., 1990). We used the regional categorizations established by the National 
Association of State Directors of Teacher Education and Certification (NASDTEC) in our analysis. 

Gender and race/ethnicity subgroups were included because they represent protected "classes" under Title 
VII of the Civil Rights Act of 1964. We used a dichotomous breakdown of teaching experience at the 
five-year point so that the judgments of less experienced teachers and more experienced teachers could 
each be represented. Only classroom teachers, not administrators or college faculty, were included in the 
analysis of teaching experience. 

A respondent category was required to have at least 30 respondents to be included in the mean 
analysis (e.g., s 30 college faculty, s 30 females). This number of respondents provides some assurance 
that the sample mean is a reasonable estimate of the corresponding population mean (Walpole, 1974). 

Due to the minimum number requirement, data for administrators were not analyzed separately. 

In addition, mean ratings were computed for the responses to the content coverage questions and the 
Recommendation for Test Content section of the job analysis survey. These analyses were computed for 
both teachers and college faculty. 

Correlations . The correlational analysis was used in this study to determine the extent of agreement 
among teachers and college faculty and among the demographic subgroups of respondents on the relative 
importance of the knowledgr efers to the similarity of the pattern of 

mean ratings generated by the different respondent groups. For example, the profile of 126 mean ratings 
for teachers is correlated with the profile of 126 mean ratings for faculty. If these two profiles tire similar 
(the shapes of the profiles correspond), the value of the correlation coefficient will be close to 1.00. 

Criterion for Interpretation of Mean Importance Ratings 

Since the purpose of a job analysis is to ensure that only the most important knowledge statements 
are included in the development of test specifications, a criterion (cut point) for inclusion is needed. For 
the importance rating scale used in the present job analysis, the value of this criterion is 2.50 (midpoint 
between moderately important arid important). This criterion is consistent with the intent of content 
validity, which is to measure only important knowledge with the assessment instrument. Therefore, 
knowledge statements that receive a mean importance rating of 2.50 or more may be considered eligible for 
inclusion in the development of test specifications; knowledge statements that receive a mean rating of less 
than 2.50 may not be considered for inclusion. This criterion has been used in similar studies (Rosenfeld 
& Tannenbaum, 1991; Wesley, 1993). Because survey participants were not involved in the development 
of the content domain, however, they may lack certain insights that the Advisory Committee members have 
due to their high level of involvement in the definition of the domain. Consequently, if the committee 
believes that a knowledge statement rated below 2.50 should be included in the specifications and the 
committee can provide compelling written rationales, those knowledge statements may be reinstated for 
inclusion in the test specifications. 



Results 



Survey Respondents 

Response rate . Of the 1,353 inventories mailed, 14 were returned incomplete because of a variety of 
reasons (e.g., wrong address, individual was retired and declined to participate). Of the remaining 1,339, 
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552 (41.2%) were completed and returned. This is a typical rate of return for a voluntary survey of some 
length conducted through the mail. 

Demographic Characteristics . Results of the analyses of the responses to the demographic questions 
in the inventory are summarized in Appendix D. The typical respondent was 35 or older (79.0%), white 
(85.9%), had at least a master’s degree (68.8%), and had 16 or more years experience in teaching music 
(55.8%). Slightly more of the respondents were female than were male (50.4% to 47.5%). The 
respondents who taught tended to do so in grades 5 - 8 (43.8%), college (31.2%), 9-12 (29.9%), and 1-4 
(24.1%). In general, it appears that the demographic composition of the survey respondents is 
representative of the teaching profession at large (cf. Feistritzer, 1986). In terms of geographic location, 
the survey respondents were reasonably well distributed across the four regions: Northeast — 22.6%, 

Central -- 26.4%, South -- 24.5%, and Far West -- 24.3%. 

Mean Importance Ratings 

Education Professionals . Means and standard deviations were computed for all respondents, and for 
teachers and college faculty, separately. Due to their length, these data are provided in Appendix E. 

Those knowledge statements rated less than 2.50 by either the teachers or college faculty are 
provided in Table 1. Of the 126 individual knowledge statements, only 22 (17.5%) did not meet the 
criterion for inclusion. This provides evidence that the iterative process undertaken to develop the survey 
was effective in identifying knowledge areas that are important for newly licensed music teachers. While 
there was general agreement, teachers tended to give slightly lower ratings than college faculty. For 
example, 19 statements failed the inclusion criterion for teachers, while 16 statements did likewise for 
college faculty. 

Demographic Subgroups . Means were computed for demographic subgroups based on sex, 
race/ethnicity, geographic region, and teaching experience. These data are tabled in Appendix F. 

Those knowledge statements rated less than 2.50 by any of the 10 demographic subgroups are 
provided in Table 2. In this analysis, 28 statements (22.2%) were rated below 2.50. All of the statements 
identified in the prior analysis of employment category were also identified in the subgroup analysis. Thus, 
the two analyses together identified 28 of the 126 statements (22.2%) that did not meet the 2.50 criterion 
Of the 28, 12 were in the Music Pedagogy category and 9 were in the Theory/Composition category. 

Primary Teaching Area Subgroups . Means were computed by primary area of teaching 
responsibility (e.g.. Choral, Band and Wind). This analysis was conducted at the request of the Advisory 
Committee members who believed that ratings for the knowledge statements would be influenced by this 
variable. These data are provided in Appendix G. 

Correlations of the Profiles of Mean Importance Ratings 

Education Professionals . Correlations were computed among arrays of means for the teachers and 
college faculty in the sample. The obtained correlation was .92, which indicates a substantial level of 
agreement across the two groups on the relative importance of the knowledge statements. 

Demographic Subgroups . Correlations were computed among arrays of means for the selected 
subgroups of respondents (e.g., males and females). This is done as a way of evaluating agreement among 



7 



ERIC 




Table 1 

Statements rated below 2.50 by Music Teachers and College Faculty 







Teachers 


College Faculty 






N = 31 0 


N = 157 


MUSIC HISTORY AND LITERATURE 






10 


Performers (past and present) 


2.48 


2.26 


11 


History of performance media 




2.39 


12 


Interrelationships among musical genres, periods, and styles 


2.40 




THEORY/COMPOSITION 






30 


Composing 


2.08 


2.24 


33 


Counterpoint 


2.18 


2.17 


37 


Properties of sound and principles of sound generation 


2.36 




38 


Physics of sound 


2.04 


2.03 


39 


Room acoustics 




2.33 


40 


Anatomy of hearing 


2.25 


2.10 


41 


Sound characteristics of electronic instruments 


1.99 


2.15 


42 


Sound characteristics of acoustic instruments 


2.29 


2.31 


44 


Tuning systems (e.g., just, Pythagorean, equal-tempered) 


1.98 


1.69 


PERFORMANCE MEDIA 






50 


Electronic instruments 


2.44 




PERFORMANCE 






65 


Guitar skills 


1.74 


2.26 


72 


Improvisation^ techniques 


2.49 




MUSIC PEDAGOGY 






95 


Suzuki 


2.33 




97 


Dalcroze 


2.39 




98 


Education Through Music (ETM) 




2.30 


104 


MIDI 


2.45 




107 


History of music education 


2.30 


2.31 


119 


Sociology of music 


2.45 


2.49 


130 


Instruction in art disciplines outside of music 




2.41 



19 
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Table 2 

Statements rated below 2.50 by Demographic Subgroups 
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subgroups. The correlations are provided in Table 3. Note that all values are above .90. This indicates a 
high level of agreement among subgroups and is consistent with findings in the job analysis literature (e.g., 
Schmitt and Cohen, 1989). 



Table 3 

Correlations of Mean Importance Ratings among Demographic Subgroups 





1 


2 


Sex 


1. Female (N=278) 


1.00 




2. Male (N=262) 


.90 


1.00 


Racial/Ethnic Background 


1 . People of Color (N=52) 


1.00 




2. White (N=474) 


.96 


1.00 


Geographic Region 


1. Northeast (N= 125) 


1.00 




2. Central (N=146) 


.97 


1.00 


3. South (N=135) 


.95 


.97 


4. Far West (N=134) 


.96 


.97 


Teaching Experience (teachers only) 


1. 1-5 years (N=47) 


1.00 




2. Greater than 5 years (N=262) 


.97 


1.00 



Primary Teaching Area Subgroups . Correlations were also computed among arrays of means for the 
primary teaching area variable. The correlations between these subgroups are provided in Table 4. While 
still high and statistically significant (p<.05), they are noticeably smaller (range .53 - .93) than the 
correlations for the employment and demographic subgroups. Thus, the Advisory Committee’s belief that 
individuals in different teaching areas would give somewhat different importance ratings was supported. 

Table 4 

Correlations of Mean Importance Ratings among Primary Teaching Area Subgroups 







1 


2 


3 


4 


5 6 7 


1 . 


Choral (N=81) 


1.00 










2. 


Band and Wind (N=136) 


.87 


1.00 








3. 


Orchestra and String (N=52) 


.85 


.70 


1.00 






4. 


Elementary General/Choral (N=146) 


.83 


.69 


.91 


1.00 




5. 


Secondary General Music (N=30) 


.82 


.79 


.53 


.56 


1.00 


6. 


Multiple Areas (N=32) 


.85 


.85 


.71 


.68 


.79 1.00 


7. 


No Response (N=75) 


.93 


.85 


.80 


.74 


.78 .88 1.00 




11 

24 



Mean Ratings of Content Coverage 



The survey participants were asked to indicate, using a 5-point rating scale, how well the statements 
within each of the five major knowledge categories covered the important aspects of the category. 
Responses to this provide an indication of the adequacy (comprehensiveness) of the content domain. The 
scale values were 1 = Poorly, 2 = Somewhat, 3 = Adequately, 4 = Well, 5 = Very well. The mean ratings 
for teachers, college faculty, and all respondents are provided in Table 5. The ratings exceed 4.0 on all 
cases except Performance Media for college faculty . This supports the notion that the major knowledge 
categories were well covered and that the overall content domain was comprehensive. 



Table 5 

Mean Ratings of Content Coverage 



Knowledge Category 


Teachers 

(N=310) 


College 

Faculty 

(N=157) 


Total 

Sample 

(N=552) 


Music History and Literature 


4.07 


4.04 


4.05 


Theory/Composition 


4.16 


4.13 


4.14 


Performance Media 


4.09 


3.97 


4.05 


Performance 


4.33 


4.15 


4.25 


Music Pedagogy 


4.31 


4.25 


4.28 



Mean Percentage Weights for Test Content Emphasis: Recommendations for Test 
Content 

Part HI of the survey, Recommendations for Test Content, asks participants to indicate how many 
test questions (out of 100) should be included from each of the knowledge categories. This information 
may be used by the Advisory Committee members to inform their decisions about the emphasis each 
knowledge category should receive in the test specifications. The mean weights for the teachers, college 
faculty and all respondents are presented in Table 6. Music Pedagogy received the highest average ratings, 
followed by Performance, Theory/Composition, Performance Media, and Music History and Literature. 
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Table 6 

Mean Percentage Weights for Test Content Emphasis 



Knowledge Category 


Teachers 

(N=310) 


College 

Faculty 

(N=157) 


Total 

Sample 

(N=552) 


Music History and Literature 


16.34 


16.89 


16.72 


Theory/Composition 


18.77 


18.05 


18.34 


Performance Media 


18.41 


16.38 


17.56 


Performance 


20.35 


19.66 


20.27 


Music Pedagogy 


26.13 


29.02 


27.12 



Summary and Conclusions 

A job analysis was conducted to define a knowledge domain important for newly licensed (certified) 
music teachers to perform their jobs in a competent manner. An initial draft domain of important 
knowledge statements was constructed by ETS Test Development staff with expertise in music and ETS 
Research staff with expertise in job analysis. This draft domain was reviewed by an External Review 
Panel of subject-matter experts and revised accordingly. The revised draft was then reviewed, modified, 
and approved by an external Advisory/Test Development Committee. The revised knowledge domain was 
then subjected to verification/refutation through the use of a national survey of music teachers, teacher 
educators, and state administrators. The survey participants were asked to rate specific knowledge 
statements of the domain using a 5-point importance scale. A cut point of 2.50 (midpoint between 
moderately important and important) was established to designate knowledge statements as eligible 
(> 2.50) or ineligible (<2.50) for inclusion in the development of test specifications. 

The results of the mean analysis conducted by teachers and college faculty indicated that 22 of 126 
knowledge statements did not meet the criterion for inclusion. This represents 17.5% of the content 
domain. When the same analysis was conducted for demographic subgroups, very similar results were 
obtained (i.e., 28 statements yielded mean ratings below 2.50). All of the statements identified in the prior 
analysis of employment category were also identified in the subgroup analysis. Thus, the data analyses 
yielded only 28 statements (22.2%) that did not meet the 2.50 criterion for inclusion. This supports the 
premise that the iterative process undertaken to develop the survey and the use of subject-matter experts 
during the process were effective in identifying knowledge areas that are important for newly licensed 
music teachers. 

The 98 knowledge statements that were verified to be important should be used as the foundation for 
the development of test specifications. Test specifications that are linked to the results of a job analysis 
provide support for the content validity of the derived assessment measures and may be considered as part 
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of an initial step in ensuring fairness. It is reasonable to assume that due to testing and psychometric 
constraints (e.g., time limits, ability to measure reliably some content) not all of the verified content may be 
included in the new assessment measure. One source of information that may be used to guide decisions 
of what verified content to include is the mean importance rating. Although a rank ordering of the content 
by mean importance rating is not implied, it is recommended that initial consideration be given to content 
that is well above the criterion and represents the appropriate breadth of content coverage as stipulated in 
the test specifications. 

The computation of correlation coefficients to assess relative agreement in terms of perceived 
importance of the knowledge statements revealed a very high level of agreement. All coefficients 
exceeded .90 for the employment and demographic subgroups. These findings indicate that there is 
substantial agreement in the importance ratings given across a wide array of education professionals. 

Evidence was also provided in this study of the comprehensiveness of the content domain within 
each of the five major knowledge categories. The results indicated that the survey respondents thought the 
categories were reasonably well covered by their statements. 

Finally, data were collected in the Recommendations for Test Content section of the survey 
regarding the test emphasis that should be given to each of the five categories. This information will be 
used by the Advisory Committee in their decisions about the appropriate weighting of the test. 

In summary, this study took a multimethod approach to identify a content domain that is related to 
the job of the newly licensed music teacher. The job analysis process allowed for input from many 
practicing professionals in music education. The results of the study will be used to develop specifications 
for the music test that will be included as part of the subject assessments of The Praxis Series: 
Professional Assessments for Beginning Teachers™. 
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INTRODUCTION 



The educators who constructed this questionnaire recognize that there is diversity in music education 
such that the job of a music teacher may vary from one setting to another. For example, the job of the 
orchestra and string teacher is different than the job of the elementary general/choral music teacher. The 
responsibilities of your job may influence the way you respond to this questionnaire. Furthermore, we will 
be categorizing and analyzing the data from the respondents according to their primary area of teaching 
responsibility. Therefore, you should indicate your primary area of teaching responsibility below. If you 
are a teacher, circle the number that represents your primary area. If you either educate prospective 
teachers or supervise beginning teachers, circle the number that represents their primary area. 



Primary Area of Teaching Responsibility 

Please circle only, one response. 

1. Choral (Grades 7-12) 

2. Band and Wind (Grades 4 - 12) 

3. Orchestra and String (Grades 4 - 12) 

4. Elementary General/Choral Music (Grades K - 6) 

5. Secondary General Music (theory, literature, appreciation, keyboard; Grades 7-12) 

Think of this area of teaching responsibility as you complete the questionnaire. Respond to each 
statement based on what you believe a newly licensed teacher in that area should know and be able 
to do. 
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PART I - KNOWLEDGE AND SKILL AREAS 



This section asks you to react to a list of knowledge and skill areas and to rate each with respect to its 
importance for a newly licensed (certified - ) music teacher . On the following pages you will find five broad 
knowledge and skill categories: 



Beneath each category there are specific knowledge and skill statements. Please make your judgments 
about each statement using the following scale: 



IMPORTANCE: How important is this knowledge or skill for newly licensed (certified) music 
teachers if they are to perform the job in a competent manner? 



To familiarize yourself with the categories and statements, you may wish to glance through Part I before 
making your rating judgments. 

Following each category is a question concerning how well you think the important aspects of the 
category are covered by the statements in the inventory. On the lines provided, note any important areas 
that you feel are not covered. 



A. Music History and Literature 

B. Theory/Composition 

C. Performance Media 

D. Performance 

E. Music Pedagogy 



0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 




NA Not applicable to primary area of teaching responsibility 



IMPORTANCE: How important is this knowledge or skill for newly licensed fcertifiedV music teachers 
if they are to perform the job in a competent manner? 

0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 



A. MUSIC HISTORY AND LITERATURE IMPORTANCE 

(Middle Ages to the present) 

1. Chronology 0 1 2 3 4 NA 

2. Genres (e.g., sonata, symphony, opera) 0 1 2 3 4 NA 

3. Periods (e.g.. Medieval, Renaissance, Classical, Romantic, 20th century) 0 1 2 3 4 NA 

4. World music (i.e., music from various cultures) 0 1 2 3 4 NA 

5- Jazz 0 1 2 3 4 NA 

6. American popular genres (e.g., folk, rock, gospel, rhythm & blues, country, 

musical theater, commercial music) 0 1 2 3 4 NA 

7. Style characteristics (melody, rhythm, harmony, form, texture, dynamics, 

timbre) 0 1 2 3 4 NA 

8. Literature/repertoire 0 1 2 3 4 NA 

9. Composers (life and works) 0 1 2 3 4 NA 

10. Performers (past and present) 0 1 2 3 4 NA 

1 1 . History of performance media (e.g., instruments, electronic media, 

voices) 0 1 2 3 4 NA 

12. Interrelationships among musical genres, periods, and styles 

(e.g., Prokofiev’s Classical Symphony) 0 1 2 3 4 NA 

13. Interdisciplinary relationships in the fine arts (e.g., impressionism in music and 

art) 0 1 2 3 4 NA 

14. Other interdisciplinary relationships (e.g., impact of historical events on 

music) 0 1 2 3 4 NA 

15. Sources of information on history and literature (e.g., the New Grove’s 

Dictionary) 0 1 2 3 4 NA 



IMPORTANCE: How important is this knowledge or skill for newly licensed (certified") music teachers 
if they are to perform the job in a competent manner? 



0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 



NA Not applicable to primary area of teaching responsibility 



Circle your response using the scale adjacent to each statement. 



A. MUSIC HISTORY AND LITERATURE (cont) 

( Middle Ages to the present ) 

16. How well do the statements in section A cover the important aspects of MUSIC HISTORY AND 
LITERATURE? 

1 2 3 4 5 

Very Poorly Poorly Adequately Well Very Well 

What important aspects, if any, are not covered? 



B. THEORY/COMPOSITION IMPORTANCE 

(includes basic musicianship) 



17. 


Harmony 


0 


1 


2 


3 


4 


NA 


18. 


Sight singing (solfege) 


0 


1 


2 


3 


4 


NA 


19. 


Sight reading 


0 


1 


2 


3 


4 


NA 


20. 


Part writing 


0 


1 


2 


3 


4 


NA 


21. 


Melodic dictation 


0 


1 


2 


3 


4 


NA 


22. 


Harmonic dictation 


0 


1 


2 


3 


4 


NA 


23. 


Rhythmic dictation 


0 


1 


2 


3 


4 


NA 


24. 


Tonality/atonality 


0 


1 


2 


3 


4 


NA 


25. 


Scale types and modes 


0 


1 


2 


3 


4 


NA 


26. 


Texture 


0 


1 


2 


3 


4 


NA 


27. 


Orchestration 


0 


1 


2 


3 


4 


NA 
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IMPORTANCE: How important is this knowledge or skill for newly licensed {'certified'! music teachers 
if they are to perform the job in a competent manner? 



0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 



B. THEORY/COMPOSITION (cont) IMPORTANCE 

(includes basic musicianship) 

28. Improvising 0 1 2 3 4 NA 

29. Arranging 0 1 2 3 4 NA 

30. Composing 0 1 2 3 4 NA 

31. Keyboard application 0 1 2 3 4 NA 

32. Form and analysis 0 1 2 3 4 NA 

33. Counterpoint 0 1 2 3 4 NA 

34. Score analysis 0 1 2 3 4 NA 

35. Notation systems (e.g., traditional Western, 20th century) 0 1 2 3 4 NA 

36. Expressive elements (e.g., dynamics, articulation, tempo, timbre) 0 1 2 3 4 NA 

37. Properties of sound and principles of sound generation (e.g., frequency, 

amplitude, sound sources) 0 1 2 3 4 NA 

38. Physics of sound (velocity, reflection, refraction, beats, harmonics, pure and 

complex tones, etc.) 0 1 2 3 4 NA 

39. Room acoustics 0 1 2 3 4 NA 

40. Anatomy of hearing 0 1 2 3 4 NA 

41 . Sound characteristics of electronic instruments (e.g., partials, attack, envelope, 

vibrato) 0 1 2 3 4 NA 

42. Sound characteristics of acoustic instruments (e.g., partials, attack, envelope, 

vibrato) 0 1 2 3 4 NA 

43. Perception of musical sounds (e.g., pitch, loudness, consonance and dissonance, 

tone quality) 0 1 2 3 4 NA 
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IMPORTANCE: How important is this knowledge or skill for newlv licensed (certified') music teachers 
if they are to perform the job in a competent manner? 


0 


Of no importance 


1 


Of little importance 


2 


Moderately important 


3 


Important 


4 


Very important 


NA 


Not applicable to primary area of teaching responsibility 


Circle your response using the scale adjacent to each statement. 



B. THEORY /COMPOSITION (cont) 

( includes basic musicianship ) 

44. Tuning systems (e.g., just, Pythagorean, equal-tempered) 



IMPORTANCE 



0 1 2 3 4 NA 



45. How well do the statements in section B cover the important aspects of THEORY/COMPOSITION? 



1 



2 

Poorly 



Very Poorly Poorly Adequately 

What important aspects, if any, are not covered? 



4 

Well 



Very Well 



C. PERFORMANCE MEDIA IMPORTANCE_ 

46. Proper fingerings, positions, bowings, embouchure, rudiments, breathing, 

etc T 0 1 2 3 4 NA 

47. Proper maintenance for instruments 0 1 2 3 4 NA 

48. Mechanical action of instruments 0 1 2 3 4 NA 

49. Instrumentation of standard instrumental ensembles 0 1 2 3 4 NA 

50. Electronic instruments 0 1 2 3 4 NA 

51. Voicings of standard choral ensembles 0 1 2 3 4 NA 

52. Vocal registers 0 1 2 3 4 NA 

53. Proper breathing and techniques for vocal production 0 1 2 3 4 NA 

54. Anatomy of vocal production 0 1 2 3 4 NA 

55. Vocal development: changes in the adolescent voice (male and female) 0 12 3 4 NA 
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IMPORTANCE: How important is this knowledge or skill for newtv licensed (certified') music teachers 
if they are to perform the job in a competent manner? 


0 


Of no importance 


1 


Of little importance 


2 


Moderately important 


3 


Important 


4 


Very important 


NA 


Not applicable to primary area of teaching responsibility 


Circle your response using the scale adjacent to each statement. 


C. PERFORMANCE MEDIA (cont.) 


IMPORTANCE 


56. The unchanged voice 


0 1 2 3 4 NA 



57. How well do the statements in section C cover the important aspects of PERFORMANCE MEDIA? 

1 2 3 4 5 

Very Poorly Poorly Adequately Well Very Well 

What important aspects, if any, are not covered? 



D. PERFORMANCE IMPORTANCE 

58. Demonstrate competent musicianship by performing the standard repertoire on 

one's principal instrument or voice 0 1 2 3 4 NA 

59. Demonstrate a competent level of performance on various secondary 

instruments or voice 0 1 2 3 4 NA 

60. Perform all major, minor, and chromatic scales and arpeggios on an 

instrument 0 1 2 3 4 NA 

61. Sing major, minor, and chromatic scales and arpeggios 0 1 2 3 4 NA 

62. Conducting 0 1 2 3 4 NA 

63. Score reading 0 1 2 3 4 NA 

64. Keyboard skills • 0 1 2 3 4 NA 

65. Guitar skills 0 1 2 3 4 NA 

66. Instrumental warm-ups and tuning 0 1 2 3 4 NA 

40 
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IMPORTANCE: How important is this knowledge or skiil for newly licensed (certified^ music teachers 
if they are to perform the job in a competent manner? 

0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 



D. PERFORMANCE (cont) IMPORTANCE 

67. Vocal/choral warm-ups 0 1 2 3 4 NA 

68. Harmonize a melody on an instrument (e.g., at keyboard, on fretted 

instrument) 0 1 2 3 4 NA 

69. Harmonize a melody vocally 0 1 2 3 4 NA 

70. Transpose a melody to a new key on an instrument 0 1 2 3 4 NA 

71. Appropriate stylistic interpretation 0 1 2 3 4 NA 

72. Improvisational techniques 0 1 2 3 4 NA 

73. Critical listening skills, including error detection 0 1 2 3 4 NA 

74. Aural identification of instruments 0 1 2 3 4 NA 

75. Aural identification of vocal types 0 1 2 3 4 NA 

76. Oral communication with an audience 0 1 2 3 4 NA 

77. Other communication with an audience (e.g., program notes) 0 1 2 3 4 NA 

78. Concert etiquette (e.g., when to applaud) 0 1 2 3 4 NA 

79. How well do the statements in section D cover the important aspects of PERFORMANCE? 

1 2 3 4 5 

Very Poorly Poorly Adequately Well Very Well 

What important aspects, if any, are not covered? 
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IMPORTANCE: How important is this knowledge or skill for newlv licensed (certified! music teachers 
if they are to perform the job in a competent manner? 


0 


Of no importance 


1 


Of little importance 


2 


Moderately important 


3 


Important 


4 


Very important 


NA 


Not applicable to primary area of teaching responsibility 


Circle your response using the scale adjacent to each statement. 



E. MUSIC PEDAGOGY IMPORTANCE 

In addition to content , music teachers need to know pedagogy specific to music. This 
includes knowledge of students, curriculum , teaching strategies , and resources. 

80. Reasons for including music in the curriculum 0 1 2 3 4 NA 

8 1 . Reasons for teaching a particular skill or concept in music 0 1 2 3 4 NA 

82. A scope, sequence, and rationale for concepts and skills taught at a given 

level 0 1 2 3 4 NA 

83. Establishing outcomes for music instruction 0 1 2 3 4 NA 

84. Prerequisite knowledge, skills, and psychomotor abilities that students must 

have before being taught a particular skill or concept in music 0 1 2 3 4 NA 

85. Ability to detect errors in students' musical performance 0 1 2 3 4 NA 

86. Ability to correct errors in students' musical performance 0 1 2 3 4 NA 

87. Awareness of students' motivations for studying music 0 1 2 3 4 NA 

88. Strategies for enhancing students' motivations for studying music 0 1 2 3 4 NA 

89. Developing creativity and aesthetic expression through music 0 1 2 3 4 NA 



Instructional strategies for use in the following settings: 



90. 


Classroom 


0 


1 


2 


3 


4 


NA 


91. 


Large ensemble 


0 


1 


2 


3 


4 


NA 


92. 


Small ensemble/sectional 


0 


1 


2 


3 


4 


NA 


93. 


Individualized instruction 


0 


1 


2 


3 


4 


NA 
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IMPORTANCE: How important is this knowledge or skill for newly licensed (certified^ music teachers 
if they are to perform the job in a competent manner? 

0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 

E. MUSIC PEDAGOGY (conD IMPORTANCE 

Pedagogical methods/approaches, such as: 

94. Kodaly 0 1 2 3 4 NA 

95. Suzuki 0 1 2 3 4 NA 

96. Orff 0 1 2 3 4 NA 

97. Dal croze 0 1 2 3 4 NA 

98. Education Through Music (ETM) 0 1 2 3 4 NA 

99. Comprehensive Musicianship Program (CMP) 0 1 2 3 4 NA 

100. Eclectic (e.g., a combination of Koddly, Orff, Dalcroze) 0 1 2 3 4 NA 

101 . Appropriate forms of representation (e.g., analogies, examples, symbols, 
drawings) for music that help make music understandable and interesting to a 

particular group of students 0 1 2 3 4 NA 

102. Identification, evaluation, and use of curricular materials and resources for 
music in ways appropriate for a particular group of students and a particular 

concept 0 1 2 3 4 NA 

103. Selection of appropriate music, including arrangements, for performance by a 

particular group of students 0 1 2 3 4 NA 

Use of Technology: 

104. MIDI 0 1 2 3 4 NA 

105. Computer 0 1 2 3 4 NA 

106. Synthesizer 0 1 2 3 4 NA 

107. Sequencer 0 1 2 3 4 NA 



IMPORTANCE: How important is this knowledge or skill for newly licensed (certified^) music teachers 
if they are to perform the job in a competent manner? 

0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 



E. MUSIC PEDAGOGY (conO IMPORTANCE 

Use of Equipment: 

108. Stereo systems 0 1 2 3 4 NA 

109. Compact discs 0 1 2 3 4 NA 

1 10. Interactive video 0 1 2 3 4 NA 

111. Electronic recording devices 0 1 2 3 4 NA 

1 12. Sound systems 0 1 2 3 4 NA 

113. Mainstreaming in the music setting 0 1 2 3 4 NA 

1 14. Evaluation strategies (e.g., observations, listening, performance tests, 

questioning techniques) appropriate to assess student progress in music 0 1 2 3 4 NA 

115. Reporting students' musical progress 0 1 2 3 4 NA 

1 16. Evaluation techniques to diagnose strengths and weaknesses in the school's 

music curriculum 0 1 2 3 4 NA 

1 17. History of music education 0 1 2 3 4 NA 

118. Philosophy of music education 0 1 2 3 4 NA 

119. Sociology of music 0 1 2 3 4 NA 

120. Psychology of music 0 1 2 3 4 NA 

121. The impact of learning theories on music education 0 1 2 3 4 NA 

122. Musical growth and development 0 1 2 3 4 NA 

123. Accommodating diverse learning styles in music instruction 0 1 2 3 4 NA 
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IMPORTANCE: How important is this knowledge or skill for newly licensed {certified! music teachers 
if they are to perform the job in a competent manner? 

0 Of no importance 

1 Of little importance 

2 Moderately important 

3 Important 

4 Very important 

NA Not applicable to primary area of teaching responsibility 
Circle your response using the scale adjacent to each statement. 



E. MUSIC PEDAGOGY (cont) IMPORTANCE 

124. Trends in music education 0 1 2 3 4 NA 

125. Professional literature in music education (e.g., books, journals, reference 

works) 0 1 2 3 4 NA 

126. Professional and student organizations for music educators 0 1 2 3 4 NA 

127. Professional ethics specific to music (e.g., copyright laws) 0 1 2 3 4 NA 

128. External influences on the music curriculum (e.g., boosters, advocacy 

groups) 0 1 2 3 4 NA 

129. Career opportunities in music (e.g., performance, teaching, business, 

technical) 0 1 2 3 4 NA 

130. Instruction in art disciplines outside of music 0 1 2 3 4 NA 



131. How well do the statements in section E cover the important aspects of MUSIC PEDAGOGY? 

1 2 3 4 5 

Very Poorly Poorly Adequately Well Very Well 

What important aspects, if any, are not covered? 
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PART n - RECOMMENDATIONS FOR TEST CONTENT 



Here are the five knowledge and skill categories covered in the first section of this inventory. If a licensing 
examination for Music teachers contained 100 questions, how many questions should be included from each category? 
If you feel a category should not be included in the exam, put 0 in the space provided. Make sure your responses total 
100 . 



NUMBER OF TEST QUESTIONS 
CATEGORIES (out of lOOi 

132. MUSIC HISTORY AND LITERATURE 

133. THEORY/COMPOSITION 

134. PERFORMANCE MEDIA 

135. PERFORMANCE 

136. MUSIC PEDAGOGY 



TOTAL 100 
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PART m - BACKGROUND INFORMATION 



The information that you provide in this section is completely confidential and will be used for research purposes 
only. Please answer the questions by circling the number that most closely describes you or your professional activities. 
Unless otherwise indicated, please circle only one response for each question. 



137. Where do you work? 



1. Alabama 


18. Kentucky 


36. Ohio 


2. Alaska 


19. Louisiana 


37. Oklahoma 


3. Arizona 


20. Maine 


38. Oregon 


4. Arkansas 


21. Maryland 


39. Pennsylvania 


5. California 


22. Massachusetts 


40. Puerto Rico 


6. Colorado 


23. Michigan 


41. Rhode Island 


7. Connecticut 


24. Minnesota 


42. South Carolina 


8. Delaware 


25. Mississippi 


43. South Dakota 


9. District of 


26. Missouri 


44. Tennessee 


Columbia 


27. Montana 


45. Texas 


10. Florida 


28. Nebraska 


46. Utah 


11. Georgia 


29. Nevada 


47. Vermont 


12. Hawaii 


30. New Hampshire 


48. Virginia 


13. Idaho 


31. New Jersey 


49. Washington 


14. Illinois 


32. New Mexico 


50. West Virginia 


15. Indiana 


33. New York 


51. Wisconsin 


16. Iowa 


34. North Carolina 


52. Wyoming 


17. Kansas 


35. North Dakota 





138. What is your age? 

1 . Under 25 

2. 25-34 

3. 35-44 

4. 45-54 

5. 55-64 

6. Over 64 



139. What is your sex? 

1. Female 

2. Male 



140. How do you describe yourself? 

1 . American Indian, Inuit, or Aleut 

2. Asian, Asian American, Hawaiian Native, or Pacific Islander 

3. Black or African American 

4. Mexican American or Chicano 

5. Puerto Rican 

6. Latin American, South American, Central American, or other Hispanic 

7. White 

8. Other 




141 . Which of the following best describes your highest educational attainment? 

1 . Less than a bachelor's 

2. Bachelor's 

3. Bachelor's + additional credits 

4. Master's 

5. Master's + additional credits 

6. Doctorate 



142. Which of the following best describes your current employment status? 

1 . Temporary substitute (assigned on a daily basis) 

2. Permanent substitute (assigned on a longer term basis) 

3. Regular teacher (not a substitute) 

4. Principal or assistant principal 

5. School administrator 

6. Curriculum supervisor 

7. State administrator 

8. College faculty 

9. Other (please specify) : 

143. How many years have you taught music? 

1 . Less than a year 

2. 1 - 2 years 
3.3-5 years 

4. 6-10 years 

5. 11-15 years 

6. 16 - 20 years 

7. 21 or more years 

8. Never taught music 



144. What grade level(s) are you currently teaching? (Circle all that apply) 

1. Preschool/kindergarten 

2. Grades 1-4 

3. Grades 5-8 

4. Grades 9-12 

5. College 

6. Do not currently teach- Administrator/Supervisor 

7. Do not currently teach-Retired 

8. Other (please specify) 



145. Circle the following professional organizations to which you belong. 

1. American Choral Directors Association 

2. American School Band Directors Association 

3. American String Teachers Association 

4. College Band Directors National Association 

5. College Music Society 

6. Music Educators National Conference 

7. Music Teachers National Association 

8. National Band Association 

9. National Black Music Caucus 

1 0. Other (please specify) 




Thank you for completing this questionnaire. 

Please return it within two weeks using the enclosed envelope. 




Appendix C 

Cover Letters and Foiiow-Up Post Card 



Cover Letter to Initial Sample 

May 1990 



Dear Colleague: 

You are invited to participate in a project that should be of importance to teachers, school 
administrators, and other professionals in the field of music education. Educational Testing Service (ETS) 
is in the process of developing a new generation of assessment measures for the purpose of licensing 
teachers. One type of assessment will measure the prospective teacher's subject-matter knowledge and will 
likely be administered upon completion of the undergraduate teacher education program. Included in this 
type is a new version of the NTE Music Education exam (a national examination for teachers). This test 
will differ from the current exam in content and design (e.g., it will not be limited to multiple-choice 
questions). Your help is needed in the development of this test. 

As part of the test development process, a group of music educators and administrators is working as 
an advisory committee to ETS (see attached list). The committee has identified potentially important 
knowledge and skill areas in music education. The enclosed questionnaire was constructed in order to 
obtain your judgments on the importance of these areas for newly licensed (certified) music teachers. Data 
from this questionnaire will guide the development of the new test. 

The questionnaire is being mailed to a sampling of individuals who have been identified with the 
cooperation of several professional organizations, such as the Music Educators National Conference 
(MENC) and the College Music Society (CMS). The usefulness of this study is dependent upon the 
number of individuals who return completed questionnaires. A preliminary study has indicated that the 
questionnaire requires less than 30 minutes to complete. 

You will notice that the inventory asks for some background information about you; this is solely for 
purposes of describing respondents. Your answers will be treated in strict confidence. 

The results of this study will be widely disseminated and have implications for the preparation of 
future music teachers. Please complete and return your questionnaire. Your participation will benefit the 
music education profession and is appreciated by ETS and the advisory committee. 

Sincerely, 



Scott Wesley, Ph.D. 
Associate Research Scientist 

Att. 

Enc. 
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List of Advisory Committee Members 
Music Education 



Adrienne Brown 
Instrumental Music Specialist 
Irvington Elementary School 
Portland, OR 

Carole Delaney 

Professor of Music and Coordinator 
of Music Education 
California State University 
at Sacramento 
Sacramento, CA 

Paul Lehman 

Professor and Senior Associate Dean 
School of Music 
University of Michigan 
Ann Arbor, MI 

Harry Mamlin 
Performing Arts Specialist 
Charlotte-Mecklenburg Schools 
Charlotte, NC 



Irma Collins 
Professor of Music 
Murray State University 
Murray, KY 

Carlesta Henderson 
Professor of Music 
Keene State College 
Keene, NH 



Carolynn Lindeman 
Professor of Music 
San Francisco State University 
San Francisco, CA 



Clair Neamand 
Vocal Music Instructor 
Parkland Senior High School 
Orefield, PA 



Ricardo D. Trimillos 
Professor of Ethnomusicology 
University of Hawaii at Manoa 
Honolulu, HI 
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Cover Letter to Supplemental Sample 



August 1990 



Dear Colleague: 

You are invited to participate in a project that should be of importance to teachers, school 
administrators, and other professionals in the field of music education. Educational Testing Service (ETS) 
is in the process of developing a new generation of assessment measures for the purpose of licensing 
teachers. One type of assessment will measure the prospective teacher's subject-matter knowledge and will 
likely be administered upon completion of the undergraduate teacher education program. Included in this 
type is a new version of the NTE Music Education exam (a national examination for teachers). This test 
will differ from the current exam in content and design (e.g., it will not be limited to multiple-choice 
questions). Your help is needed in the development of this test. 

As part of the test development process, a group of music educators and administrators is working as 
an advisory committee to ETS (see attached list). The committee has identified potentially important 
knowledge and skill areas in music education. The enclosed questionnaire was constructed in order to 
obtain your judgments on the importance of these areas for newly licensed (certified) music teachers. Data 
from this questionnaire will guide the development of the new test. 

The questionnaire is being mailed to a sampling of individuals who have been identified with the 
cooperation of several professional organizations, such as the Music Educators National Conference 
(MENC) and the College Music Society (CMS). The usefulness of this study is dependent upon the 
number of individuals who return completed questionnaires. A preliminary study has indicated that the 
questionnaire requires less than 30 minutes to complete. 

You will notice that the inventory asks for some background information about you; this is solely for 
purposes of describing respondents. Your answers will be treated in strict confidence. 

The results of this study will be widely disseminated and have implications for the preparation of 
future music teachers. Please complete and return your questionnaire. Your participation will benefit the 
music education profession and is appreciated by ETS and the advisory committee. 

Sincerely, 



Scott Wesley, Ph.D. 
Associate Research Scientist 
Att. 

Enc. 
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List of Advisory Committee Members 
Music Education 



Adrienne Brown 
Instrumental Music Specialist 
Irvington Elementary School 
Portland, OR 

Carole Delaney 

Professor of Music and Coordinator 
of Music Education 
California State University 
at Sacramento 
Sacramento, CA 

Paul Lehman 

Professor and Senior Associate Dean 
School of Music 
University of Michigan 
Ann Arbor, MI 

Harry Mamlin 
Performing Arts Specialist 
Charlotte-Mecklenburg Schools 
Charlotte, NC 



Irma Collins 
Professor of Music 
Murray State University 
Murray, KY 

Carlesta Henderson 
Professor of Music 
Keene State College 
Keene, NH 



Carolynn Lindeman 
Professor of Music 
San Francisco State University 
San Francisco, CA 



Clair Neamand 
Vocal Music Instructor 
Parkland Senior High School 
Orefield, PA 



Ricardo D. Trimillos 
Professor of Ethnomusicology 
University of Hawaii at Manoa 
Honolulu, HI 
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Follow-Up Post Card 



JOB ANALYSIS INVENTORY 
FOR MUSIC TEACHERS 



Dear Colleague: 

An inventory was recently sent to you to obtain your opinions of what a newly 
licensed music teacher should know and be able to do. If you have not already 
done so, please complete the inventory and return it in the postage-paid 
envelope to: 



Educational Testing Service 
Mail Stop 11-P 
Princeton, NJ 08541 



If you have already returned the inventory, please accept my thanks for your 
help in this important project. 

Sincerely, 

Scott Wesley, Ph.D. 

Associate Research Scientist 
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Appendix D 

Demographic Distributions 
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Overall Sample 
(N = 552) 



Number 


Percent 


PRIMARY TEACHING RESPONSIBILITY AREA 






Choral (Grades 7-12) 


81 


14.7 


Band and Wind (Grades 4-12) 


136 


24.6 


Orchestra and String (Grades 4-12) 


52 


9.4 


Elementary General/Choral Music 
(Grades K - 6) 


146 


26.4 


Secondary General Music (theory, literature 
appreciation, keyboard; Grades 7-12) 


30 


5.4 


Multiple Response (i.e., more than one area) 


32 


5.8 


No response 


75 


13.6 


AGE (years) 






Under 25 


11 


2.0 


25-34 


94 


17.0 


35-44 


204 


37.0 


45-54 


137 


24.8 


55-64 


82 


14.9 


65 and over 


13 


2.4 


No response 


11 


2.0 


SEX 






Female 


278 


50.4 


Male 


262 


47.5 


No response 


12 


2.2 




D-3 



56 



Overall Sample 
(N = 552) 



Number 


Percent 


RACE/ETHNICITY 






American Indian or Alaskan Native 


5 


0.9 


Asian, Asian American, Hawaiian Native, or Pacific Islander 


8 


1.4 


Black or African American 


35 


6.3 


Hispanic 


2 


0.4 


White 


474 


85.9 


Other 


2 


0.4 


No response 


26 


4.7 


HIGHEST EDUCATIONAL ATTAINMENT 






Less than Bachelor's 


0 


0.0 


Bachelor's 


15 


2.7 


Bachelor's + Credits 


134 


24.3 


Master's 


47 


8.5 


Master's 4* Credits 


188 


34.1 


Doctorate 


145 


26.3 


No response 


23 


4.2 


CURRENT EMPLOYMENT STATUS 






Temporary Substitute 


2 


0.4 


Permanent Substitute 


1 


0.2 


Regular Teacher (not a substitute) 


309 


56.0 


Principal or Assistant Principal 


0 


0.0 


School Administrator 


0 


0.0 


Curricular Supervisor 


4 


0.7 


State Administrator 


20 


3.6 


College or University Faculty 


157 


28.4 


Other 


25 


4.5 


No response 


34 


6.2 




D-4 



57 



Overall Sample 
(N = 552) 



Number 


Percent 


TEACHING EXPERIENCE 






Less than 1 year 


5 


0.9 


1-2 years 


14 


2.5 


3-5 years 


34 


6.2 


6-10 years 


69 


12.5 


11-15 years 


97 


17.6 


16-20 years 


103 


18.7 


21 or more years 


205 


37.1 


Never taught music 


1 


0.2 


No response 


24 


4.3 


GRADE LEVELS CURRENTLY TEACHING 1 






Preschool/Kindergarten 


73 


13.2 


Grades 1 - 4 


133 


24.1 


Grades 5-8 


242 


43.8 


Grades 9-12 


165 


29.9 


College 


172 


31.2 


Do Not Teach (supervisor/administrator) 


28 


5.1 


Do Not Teach (retired) 


7 


1.3 


Other 


40 


7.2 


PROFESSIONAL ORGANIZATIONS 1 






American Choral Directors Association (ACDA) 


116 


21.0 


American School Band Directors Association (ASBDA) 


24 


4.3 


American String Teachers Association (ASTA) 


64 


11.6 


College Band Directors National Association (CBDNA) 


19 


3.4 


College Music Society (CMS) 


78 


14.1 


Music Educators National Conference (MENC) 


488 


88.4 


Music Teachers National Association (MTNA) 


41 


7.4 


National Band Association (NBA) 


36 


6.5 


National Black Music Caucus (NBMC) 


24 


4.3 


Other 


240 


43.5 



i 




Multiple responses were allowed. Hence, the total will not add up to 552. 

D-5 



58 



Overall Sample 
(N = 552) 



Number 


Percent 


GEOGRAPHIC REGION 






Northeast 


125 


22.6 


Central 


146 


26.4 


South 


135 


24.5 


Far West 


134 


24.3 


No response 


12 


2.2 




D-6 



59 



Appendix E 

Importance Ratings for Teachers and College Faculty 



cm 

CD 




© 

1 

! 

o 

c 

o> 

c 

CD 

X3 



C 

CD 

E 

© 



2 

« 

c 

© 

X3 

C 

o 

CL 

CO 

CD 

CD 

E 

O 

CD 

O 

E 

o 

m [rj 

CM 



>. 

C 

o 

XT 

CL 

l 

CO 

©“ 

03 

c 

o 

CO 



>. C? 

g* ®. 

O © 

c 0) 

9 c 

SI CD 

o o 



© 

3 

"5 

_ o 

8 3 

« -§ 

8 § 

8 § 

S 2 

o 

© CO 

> 3 

I E . 

-§ © 



d> 2 
® 8 



CL 

CO 

o 

CD 



JC 

o 

d> 

©, 

CO 

© 

c 

© 

CD 

« 

3 

CL 

O 

CL 

C 

© 



5- 

© 

T5 

C 

© 

10 

TD 

O 



© 

t: 

© 

© 

c 



o 

■E 

© 

CL 



jg « 

*3 © 

1 * 
§ “ 
£ S 

= CL 



© © 
T3 = 
© 

E cd 
© § 
c E 
© © 
E © 
o -g- 

E 



« 
Q. 

x: 
© 
c 

E *E m 



E 

O 


E 

TC 


N 


o 

© 


o 

© 


2 


*3 

© 


O 


N 

© 


E 


5 


© 


Q_ 


5 


“3 


< 


CO 


Z3 


CO 




in 


CO 


r- 


00 



« 

© 

© 

o 

CL 

E 

o 

O 



« 

© 

g 

o 

E 

© 

CL 



© 



© 

c 

__ o 

° 3 

c* © 
o fc 
© © 
X = 

CM 



© 

c 

o 

© 

© 

© 

c 



© 

© 

© 

c 



© 

3 

© 



T3 

C 

© 

o 

© 

x: 

c 

o 

c 

o 



o £ £ 

© »— 

*2 
© 
c 



-^ © ±= 



*5 5 

© x: 
£ 6 



o 

« 

© 



o 

CO 





CD 












<2 

o 






C 


c 

o 




© 






.2 


© 




o> 

c 


CD 

C 


CD 


© 

o 


5 

E 


>» 

c 


CD 

c 


E 

© 

© 


C 

“C 


■a 

o 


O 

c 


o 

E 


© 

xr 


xr 


tr 


E 

o 


o 

E 


© 

X 


CD 

CO 


CD 

CO 


© 

CL 


© 

5 


© 

X 


r- 


00 


CD 


O 




CM 






T— 


CM 


CM 


CM 



c 

o 



© 

© 



c 

o 

E 

*o 

© 

c 



© 

© 

o 

in 

CM* 

c 



LU 
— J 
CD 
<C 



<C 

>- 

Q- 

8 

LLi 

CD 



£ © © == 



e 

o 

E 

.c 

% 

jC 

X 



© 

© 

_© 

© 

CD 

c 



E 

x: 

1 

© 

© 

u 

© 

xa 

© 



CD 



O 

ERIC 



© 

o 

Z 




« 





■o 






o 






E 




& 


TJ 




CO 

c 


C 

CO 




o 


« 




45 


0) 

CL 










(0 

c 


© 

CO 


3 

*£ 


o 


o 


0) 


\— 


C/5 


H 


rt 


w 


co 


04 


04 


04 




ca 



00 

CO 




48 Mechanical action of Instruments 



co 

CD 





o 

ERIC 



CO 

CD 






I s ” 

CD 



o 







cv? 

iN 








© 














o 


“CA 


© 










© 

<_> 

3 


© 


© 

o 










T3 

© 


H 


o 

43 










03 












O 

© 


>% 


03 










3 


CL 


03, 










E 


O 

U 


¥ 




O 






v_ 






© 




c 

o 


O 

© 


03 

©^ 


3 

3 

O 




3 

E 




© 


c 




*c 








u 


o 


o 






o 


c 


=3 

•o 

© 

o 

© 

13 

E 


© 

rsi 

c 

© 

2> 

o 


© 

3 

E 

o 

o 


D 

u 

o 

© 

3 

E 

© 


O 

© 

3 


© 

■O 

OT 

3 

O 

© 

© 


o 

© 

o 


c 

£ 


c 

© 

*0 


o 

© 

Q. 


£ 

c 


E 


c 

Q. 


3 




3 


© 


o 


© 


O 


TJ 


3 


« 


© 


© 


© 


© 


(D 


£ 


o 


© 






O 


© 


"O 

c 


£ 


o 

c 


c 

3 


•c 


00 




© 


© 


© 


■c 


© 


13 








3 


Q 


c 


E 


© 

c 


© 

c 


© 

c 


C 


CL 


c 


c 


o 


o 


o 




O 


o 


03 

■D 

C 

® 


(A 


© 


© 


© 






(A 

© 

2 


© 

© 

2 


© 

© 

2 


c 

© 

H 


© 

© 

© 


<-> 

3 

© 




Q_ 


£ 


Q_ 


LU 


o 


c 


^r 


in 


CD 


N. 


00 


03 


o 


CM 


CM 


CM 


CM 


CM 


CM 


CO 




v==4 



Appendix F 

Importance Ratings for Demographic Subgroups 
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Appendix G 

Importance Ratings bv Primary Area of Teaching Responsibility 
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